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Abstract 

During  the  last  few  years  a  number  of  relatively  effective  AI  prof',ramf; 
have  been  written  incorporating  consid'^rable  amounts  of  problem  specific 
knowledge.   Consequently,  the  problem  of  encoding  such  knowledge  in  a  useful 
form  has  emerged  as  one  of  the  central  problems  of  AI.   In  part  icular. 
Declarative  representations  of  knowledge  have  attracted  much  attention  partly 
bccauf.e  of  the  relative  ease  with  which  knowledge  can  be  communicated  in 
this  form.   Unfortunately,   implementation  of  Declaratively  specified  knowl- 
edge corresponds  to  a  non-deterministic  program  which  incurs  enormous  compu- 
tational costs. 

This  paper  discusses  one  way  to  limit  this  cost.   The  approach  we  take 
is  to  develop  control  heuristics  for  a  family  of  problems  froiu  traces  of 
sample  solutions  generated  during  a  training  session  with  a  human  expert. 
Algorithms  have  been  developed  which  recognize  a  predefined  set  of  patterns 
in  the  sequence  of  'knowledge  applications'  and  which  compile  descriptions 
of  these  patterns  in  a  control  language,  called  CRAPS.   More  specifically, 
patterns  of  repeating,  parallel  and  common  sequences  are  considered  in  the 
analysis.   The  Cl^PS  descriptions  generated  are  then  used  for  guidance  in 
solving  subsequent  problems.   We  discuss  the  utility  of  such  an  approach  and 
give  an  example  of  a  generated  CRAPS  description. 


1.   Introduction 

During  the  last  few  years,  a  number  of  relatively  effective 
Artificial  Intelligence  programs  have  been  written  incorporating 
considerable  amounts  of  knowledge,  and  the  problem  of  encoding 
such  knowledge  in  a  useful  form  has  emerged  as  one  of  the  central 
problems  of  AI.   Winograd  [16]  distinguishes  between  declarative 
information  which  can  be  thought  of  as  "knowing  what",  and  procedural 
information  which  can  be  thought  of  as  "knowing  how".   He  describes 
the  underlying  problem  as  that  of  conr.tructing  representations 
which  can  take  advantage  of  the  decompoccjbility  of  the  declarative 
representation  v/ithout  sacrificing  the  interactive  possibilities  of 
the  procedural  representation.   Ideally,  it  should  be  possible  to 
specify  information  in  a  form  which  does  not  constrain  the  way  in 
which  it  is  to  be  used;  unfortunately,  a  straightforward 
implementation  of  such  a  declarative  representation  corresponds  to 
a  non-deterministic  program  which  makes  a  relatively  blind  search 
through  the  solution  space. 

More  recently,  attention  has  turned  towards  mechanisms 
which  facilitate  incorporating  limited  procedural  or  heuristic 
information  into  a  primarily  declarative  framework.   For  example, 
Rychener's  approach  [9  ]  is  to  build  a  rational  "goal"  structure 
into  declarative  rule-based  systems,  while  Davis  [2  ]  favors  a 
separate  set  of  "meta-rules"  specifying  control  information.   In 
P(^fn«3  rri ooc;  vTo  r/'i'''l''t  '^xT'Cct  thr.t  the  nrr.cv.rit  cf  ^^rcccdurcil  inforTTiatz-cr. 
is  of  the  saiTie  ordei.  of  macmitude  as  the  amount  of  denl  nrai- -i  vr> 
information,  and  so  £uch  approaches  may  be  effective.   However,  in 
most  cases  the  amount  ot  control  information  will  be  very  large 
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(e.fj.  theorem-proving,  natural  language  understanding)  . 
Thufj  the  problem  of  acquiring,  debugging  and  extending  control 
information  will  become  increasingly  important. 

In  general,  v;e  might  expect  tliat  this  control  information 
will  embody  very  sophisticated  principles  requiring  data-structures 
not  present  in  the  declarative  forra  of  the  program,  or  which  are 
only  dcducible  by  the  use  of  considerable  intelligence.   For  example, 
it  is  clear  that  the  incorporation  of  the  heuristic  principles  of 
evaluation  and  ct-B  search  into  a  declarative  chess  program  which 
specifies  only  the  rules  of  chess  but  no  strategies  for  playing 
will  require  an  analysis  which  is  considerably  beyond  the  ability 
of  present  techniques;  even  the  optimization  of  the  parameters  in 
a  linor.r  evaluation  function  involves  highly  sophisticated  processing 

However,  we  believe  that  there  are  a  number  of  important 
areas  in  which  it  might  be  possible  to  deduce  control  information 
automatically  from  a  declarative  program.   These  include  declarativelj 
specified  problems: 

o    for  v;hich  there  exists  a  relatively  simple  algorithmic 
procedure; 

»  whose  performance  can  be  improved  in  frequently  occurring 
or  particularly  im.portant  special  cases; 

"    in  which  particular  subproblems  can  be  solved  by  simple 
algorithmic  procedures. 
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Some  work  on  this  problem  was  reported  by  Fikes,  Hart  and  Nilsson 
14]  .   In  their  system,  STRIPS,  sequences  of  operator  applications 
used  in  solving  sample  problems  were  stored  for  possible 
guidance  (or  planning)  in  solving  subsequent  problems.   In  this 
paper  we  report  on  a  somewhat  different  approach,  which  stresses 
the  importance  of  a  deeper  analysis  of  the  sequence  of  operator 
applications.   A  similar  approach  has  been  adopted  by  Phillips  [8] 
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2.   A  Scimple  Problem 

As  an  example,  consider  the  following  problem.   Suppose  we 
want  to  solve  a  (slightly  idealized)  jig-saw  puzzle,  in  which  each 
piece  has  an  average  color,  and  four  sides  described  by  unique 
integers  (with  side  i  fitting  side  -i)  .   V7e  consider  below  a 
non-deterministic  algorithm  written  in  production  language  form. 
An  informal  description  of  the  productions  we  might  use  would 
include: 

r;TART-- PUZZLE:   If  there  is  no  puzzle  currently  being  built  and 
y.ni   are  holding  a  piece,  then  you  can  make  this  piece  the  first 
I'iirtof  the  puzzle,  leaving  your  hand  empty.   Notice  that  you 
continue  to  look  at  the  piece. 

LOOK--AT-PIECE-IN-HEAP:   If  a  piece  is  in  the  heap  then  you  can  look 

PICK--UP-OBJECT-IN-VIEW:   If  you  are  looking  at  an  obiect  and 
holdmy  nothing,  then  you  can  pick  up  the  object.   Its  position 
changes  to  being  in  your  hand. 

LOOK-AT-OBJECT-IN-HAND:   If  something  is  in  your  hand,  then  you 
c:cin  look  at  It. 

SoSS?Mr^jK'   ^^  ^°''  ""^^  looking  at  something  which  is  not 
NOTHING  then  you  can  look  at  NOTHING. 

9^1^.^^'^-^^-^'^^^:^^-^^^'^''      This  production  senses  when  the  object 
being  held  is  in  view  without  performing  any  actions. 

^00?"^^°'':^^'^'''^^  •  '^  ^°"  ^^"^  holding  a  puzzle  piece,  you  can 
look  at  It  and  know  its  color. 

PIECE-HAS-CURRENT-COLOR:   This  senses  when  the  object  being  held 
has  the  current  color  you  are  considering. 

FORGET-COLOR-OF-PIECE:   If  a  piece  is  in  view  and  you  know  its 
color,  you  can  look  away  from  it  and  forget  the  color. 

^^^t^^t^^Y^:^"^:^,:^^^   production  senses  when  the  piece 
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o  i^x  ci  J.M  11  t_  c:»j.e*  t: 


PUT-PIECE-DOWN-IN-HEAP:   If  you  are  holding  a  puzzle  piece,  you 
can  put  It  in  1-h^  h^^n  ^nrl  yr^nr  band  i=  -r.^^^.    xt^^^^^^kX:  1° 
piece  continues  to  be  in  view. 


ir  — _i 
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HEAP-IS-EMPTY:   This  senses  if  the  heap  is  empty. 

PIECE-FITS-IN-PUZZI.E:  This  production  senses  when  a  puzzle 
piece  that  is  in  view  will  fit  another  puzzle  piece  already 
in  the  puzzle. 

FIT-PIECE-IN-PUZZLE:   If  the  piece  being  held  and  in  view  fits 
in  the  puzzle,  the  sides  of  the  matching  pieces  can  be  joined. 

PIECE-PUT-IN-PUZZLE:   If  you  are  holding  a  puzzle  piece,  V7}iich 
is  being  placed  in  the  puzzle,  you  could  put  it  down  in  the 
puzzle. 

PUZZLE-IS-FINISHED:   If  all  of  the  pieces  are  in  the  puzzle,  you 
can  halt. 

Tho  complete  prograia  is  given  in  Appendix  I. 

It  should  be  noted  that  this  representation  is  highly 

non-deterministic,  and  if  executed  would  bn  hyper-exponent JaJ.ly 

inefficient.   It  does  not  even  "know"  that  it  will  find  a 

solution  (i.e.  terminate)  if  it  can  repccit  the  production 

PUT-PIECE- XN"PUZZLiJ  as  frequently  as  pocsiblc,  so  even  tl.o 

crude.st  goal-subgoril  .'structure  is  absent.   (However,  there  is 

no  production  to  rentove  a  piece  from  tht^  puzzle,  which  v-crvey   a.s 

a  clue  to  an  intelligent  observer)  .   It  xv,   even  possible  for  the 

program  to  pick  up  a  piece  and  then  put  it  down  immediately 

without  doing  anything  with  it. 

The  performance  of  this  program  could  be  improved  to  a 

tolerable  level  if  the  following  heuristic  was  added: 

.  use  the  follov/ing  sequence  repeatedly 

pick  up  a  piece  from  the  heap; 

inr.ert  it  in  the  puzzle  if  it  fits. 
An  alLeriiO.Livc  heaxisLiu  would  be: 

.  UEO  tiio  follcv.'ing  zccrac.r.oc   repeatedly 

locate  a  piece  p  in  the  puzzle  with  a  missing  neighbor; 

pick  up  pieces  from  the  heap  until  one  matches  p,  and 
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insert  it  in  the  puzzle. 
Each  of  those  heuristics  is  very  simple,  consisting  mainly  of 
sequencing  rules  for  the  productions,  and  would  seem  to  be 
within  the  range  of  automatic  inference.   A  further  improvement 
could  be  made  by  noting  that  the  procedure  for  selecting  a  piece 
from  the  heap  is  inefficient  since  the  same  piece  may  be  selected 
repeatedly  (and  in  a  production  system  such  as  that  of  Rychener 
[10]  which  prefers  to  use  recently  referenced  items  in  working 
memory,  in  other  respects  a  reasonable  strategy,  the  search  will 
almost  always  be  ineffective) .   If  we   add  a  few  more  productions, 
it  becomes  possible  for  the  system  to  search  systematically 
through  the  heap  by  constructing  a  pile  from  the  pieces  in  the 
heap,  and  putting  a  piece  down  in  a  different  pile  when  it  has 
looked  at  it. 


MAKE-A-PILE:   If  you  want  to  make  a  pile  and  you  are 

holding  something,  put  it  in  t]ie  pile  and  your  hiind  is  empty. 

The  object  continues  to  be  in  view. 

PICK-A-PILE:   If  you  are  not  v7orking  with  a  pile,  just  pick 
the  first  one. 

PICK-OBJECT-FROM-PILE:   To  pick  an  object  from  a  pile,  if  your 
hand  is  empty  reach  in  and  pick  up  the  first  one  you  see. 

PUT-OBJECT-IN-PILE:   To  put  an  object  in  a  pile,  if  you  are 
holding  something,  just  place  it  in  the  back  of  the  pile  and 
your  hand  is  empty. 

FORGET-THIS-PILE:   To  forget  a  pile,  just  push  the  current  pile 
behind  all  the  others. 

PILE-IS-EMPTY:   A  pile  is  empty  ,  if  there  is  nothing  on  it. 

DECTIvCY-A-riLE:   To  dcbLroy  Luc  cuij-tJiiL  pile,  just  strike  it 
from  memory. 

THERE-ARE-NO-PILES:   There  are  no  piles  if  all  the  piles  were 
destroyed. 
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LOOK-AT-FIRST-IN-PILE:   If  there  is  an  objeci:  at  the  front  of 
the  pile,  you  can  focus  on  it. 

LOOK-AT-NEXT-IN-PILE:   If  you  want  to  scan  through  a  pile  and 
you  are  looking  at  the  first  object  in  it,  focus  on  the  next 
one  by  placing  the  first  object  behind  the  last. 

The  actual  pile  productions  can  be  found  in  Appendix  II. 

The  pile  productions  are  very  general,  and  might  be 
expected  to  be  precent  in  any  system;  indeed,  it  seems  likely 
thcit  productions  for  dealing  with  heaps  and  piles  (i.e.  sets  and 
tuples)  and  heuristics  for  implementing  .ijnpor ;  ,i]it  operations  such 
as  searching  will  bo  present  in  production  i.ystcvd'^   as  they  arc 
in  modern  progrcxrnming  languages  [3]  . 

Carrying  our  jig-saw  puzzle  a  step  or  two  further,  sufficient 
productions  are  present  now  to  permit  siraple  r^oquencing  heuristics 
to  reflect  the  usual  strategies  used  by  experienced  puzz^c-solvcrs; 

.  work  on  the  outside  edge:-;  first  (build  a  pile  of  outside 
edges)  ;  repeat  the  PUT-PIECE-IN-PUZZLE  sequence  until  thif;  pile 
is  empty; 

.  separate  the  pieces  in  the  heap  into  piles  of  the  same 
average  color,  and  search  the  £ippj;opri£ite  pile  first; 

.  search  first  for  pieces  which  have  more  than  one  neighbor 
of  the  same  average  color  (e.g.  work  on  the  s);y  first); 

It  may  appear  that  automatic  detection  of  such  heuristics  is  a 
task  of  great  difficulty.   Belov;  we  outline  an  approach  to  this 
probleiTi  which  we  believe  can  be  quite  successful,  describe  a 
Gystojn  which  has  been  embeeded  in  PROSYS,  an  extension  of 
0PS2  [5] ,  and  give  some  preliminary  results. 
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3 .   Approacli 

Our  procedure  is  as  follows:   we  select  a  'typical'  input 
to  the  program  and  run  the  program  repeatedly  on  this  input, 
recording  the  sequence  of  rules  selected.   This  is  repeated  for 
other  typical  inputs.   We  then  attempt  to  describe  the  better 
(i.e.  shorter)  successful  sequences  in  a  language,  CRAPS, 
designed  for  this  purpose  and  described  in  the  next  section. 
We  then  use  this  description  to  guide  the  program's  subsequcait 
deci  sions. 

Inherent  in  this  approach  is  the  assu:ni)tion  that  good 
decision-making  procedures  or  heuristics  can  be  inferred  from 
the  perforraanco  of  the  program  on  only  selected  inputs.   In 
general,  as  suggested  by  v;ork  or  indiictive  inference  [17]  and 
information  theory  [1,6,11],  we  will  give  preference  to  short 
CRAPS  descriptions  which  will  generate  a  high  proportion  of 
short  successful  solutions  and  fev/  long  or  unsuccessful  solutions. 
We  anticipate  that  the  selection  of  inputs  v/ill  be  critical  cxnd 
that  eventually  we  will  v;ant  to  be  able  to  handle  new  inputs 
increj'aentally,  as  was  done  in  [17].   Initially,  however,  v;c  v/111 
concentrate  on  the  simpler  problem  of  getting  a  good  solution 
for  the  non-incremental  case. 

>\5  suggested  by  the  example  in  section  2,  the  execution-time 
of  a  completely  declarative  program  will  usually  be  too  long  to 
perr;.it  a  solution  c::r.cpt  in  the.  simpler  cases.   Accordingly, 
we  will  run  the  Drnarnm  in  " t-ta i  n n  nrr  mnrici"  in  which  its  decir.'icr.E 
can  he:   observed  and  if  necessary  corrected.   In  initial  exporiiaents 
this  will  be  done  by  a  trainer  who  is  aware  of  the  structure  of 
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the  program;  subsequently  we  anticipate  the  necessity  of  using 
techniques  similcxr  to  those  of  Davis  [2]  ,  which  will  enable 
the  trainer  to  deal  only  with  the  external  behavior  of  the 
program. 

It  should  be  noted  that  we  have  deliberately  chosen  to  exclude 
information  about  sequences  which  end  in  failure.   It  is  clear 
that,  cis  found  by  Winston  in  other  inductive  inference  v;ork  [17]  , 
counter-examples  will  be  extrojnely  valuable.   However,  as  the 
reader  will  note  below,  even  this  simpler  problfim  poses  considercible 
technical  difficulties,  and  it  was  our  feeling  that  a  clearox 
picture  would  emerge  from  the  simpler  approach.   Furthci.rmore, 
initial  experiments  described  in  section  5  suggecit  that  useful 
results  can  be  obtained  without  counter-example?.. 
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4  .   The  CRAPS  lemcjugge 

The  CRAPS  language  provides  a  semantic  framework  with  which 
to  specify  or  describe  sequences  of  rule  applications  in  the 
execution  of  the  non-deterministic  program.   The  most  basic 
primitive  of  CRAPS  is  called  a  unit.   A  unit  specifies  either  a 
rule  application  with  preconditions,  or  a  control  operation 
applied  to  a  sequence  of  units.   The  control  operations  are: 

(1)  Concatenation  of  units  producing  sequences; 

(2)  Repetition  of  a  sequence  of  units  controlled  by 
Boolean  conditions; 

(3)  Alternative  (or  conditional)  selection  of  a  sequence 
from  a  set  of  sequences; 

(4)  Perrautiitiun  of  a  set  of  sequences.   (Thus,  the 
acronym  CRAPS, ) 

Conditiojic;  in  the  above  are  DNF  expressions  of  rules,  with  a 
rule  being  considered  true  if  it  is  fireable. 

The  oijorators  of  CRAPS  correspond  to  control  primitives  of 
conventional  prograrnraing  languages.   Concatenation  corresponds  to 
sequential  execution  of  statements,  and  repetition  corresponds  to 
iteration  statements  with  'while'  and  'until'  termination  condi- 
tions.  The  alternation  operator  specifies  alternative  sequences 
of  actions  much  like  an  ALGOL-68  'case'  statement  or  LISP  'cond' 
expression.   The  permutation  primitive  represents  a  form  of 
concuirent  execution  similar  to  the  specification  of  col].atcral 

An  example  of  a  CRAPS  deficripti on  c?n  be  found  in  cecticn  5. 
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5.   An  Example:^  Binary  Tree  Traversal 

The  program  in  figure  1  has  the  ability  to  scan  a  binary  tree  in 
any  order.   No  control  information  is  specified  in  any  of  the 
productions.   The  productions  have  been  chosen  to  encode  all  of 
the  relevant  information  about  scanning  a  binary  tree  without 
specifying  direction. 

A  binary  tree  is  represented  in  working  memory  by  the  following 
data  format.   The  root  of  the  tree  is  represented  by  (ROOT  =X)  where 
=X  can  be  bound  to  any  symbol.   If  node  B  hac  a  left  son  A,  it  is 
represented  by  (LEFT  B  A)  and  similarly  (RIGHT  B  C)  represents  C  as 
the  right  son  of  B.   The  father  of  a  node  (either  left  or  right)  is 
represented  for  example  by  (FATHER  B  A)  .   TJie  current  node  being 
scanned  is  represented  by  (NODE  =X).  In  scanning  binary  trees,  nodes 
can  be  printed  only  once.   If  node  A  has  been  scanned  and  printed, 
theii  (ALREADY-P  A)  is  deposited  in  working  memory. 

Several  binary  trees  were  placed  in  v/orking  memory  and  then  the 
progranwas  initiated  and  directed  by  a  human  to  scan  in-order  each 
tree.   A  trace  for  each  execution  was  produced  (see  figure  2  for 
examples) .   The  entire  set  of  traces  was  presented  to  the  pattern 
recognition  algorithms,  which  produced  the  CRAPS  description 
presented  in  figure  3  .   The  integers  labelling  the  rule  names  in 
the  final  description  are  meant  to  differentiate  particular  in- 
stances of  rule  applications.   For  example  (15.  PRINT)  is  a 


\  ^  <  •   ^  »VJ.».  ^  , 


In  this  particular  case  the  CRAPS  deKcriprion  is  a  prrr-iKf 
definition  of  an  in-order  balanced  binary  tree  scan  program.   That 
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is,  given  a  working  memory  specifying  a  balanced  binary  tree,  the 
shortest  execution  sequence  of  the    program  which  v/ould  result 
in  an  in-order  print  of  the  nodes  would  belong  to  the  set  of 
sequences  specified  by  the  CRAPS  description;  furthermore,  the 
CRAPG  description  provides  enough  information  to  determine  v;hich 
production  should  be  fired  at  every  point  in  the  execution  of 
the    program.   Thus  a  non-deterministic  program  has  in  effect 
been  reduced  to  a  deterministic  program. 

In  general,  we  cannot  assume  that  the  CRAPS  description  will 
be  as  effective  as  this.   With  poor  training  sequences,  or  incorrect 
analyses  of  execution  traces,  CR/vPS  descriptions  may  imply  heuristics 
which  are  not  helpful,  or  which  are  helpful  for  some  examples  and 
harmful  in  others.   The  initial  approach  v;e  implemented  was  that 
of  Rychener's.   The  existing  program  was  altered  by 
including  special  'tag'  or  'control  elements'  in  both  sides  of 
the  rules  to  reflect  the  control  information  in  the  description. 
This  approach  appeared  to  impose  too  high  a  level  of  control 
affecting  much  of  the  quality  of  the  production  system  representa- 
tion v/hich  makes  it  attractive.   Although  the  original  trees 
used  in  the  training  sequence  and  other  trees  were  able  to  be 
traversed  correctly,  several  other  instances  of  trees  were  not. 
This  has  led  us  to  consider  Davis'  approach  of  "meta-rules"  with 
a  probabilistic  component  to  them.   In  this  direction,  a  CPJVPS 
description  would  be  transformed  to  a  set  of  rules  which  suggest 
profererces  of   rules  over  others  during  the  testing  and  selection 
process  on  each  execution  cycle.   We  are  currently  looking  at  wavti 
of  doing  this. 
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Figure  1.  Binary  Tree  Scanning  Production  System 

START-POINTING 
[  (ROOT  =x)   -(NODE  =  anything)   — >   (NODE  =x)  ] 

GO-LEFT 

[(NODE  =x)  (LEFT  =x  =  y)   ->  «delete>  (NODE  =x)  )  (NODE  ^  x)  (FATHER  =x  =  y)  j 
GO-RIGHT 

[  (NODE  =x)  (RIGHT  =x  =  y)  — >  «delete>  (NODE  =x)  )  (NODE  -  y)  (FATHER  =x  =  y)  ] 

CAN-T-GO-LEFT 
[  (NODE  =x)  -(LEFT  =x=  anything)  — >   ] 

CAN-T-GO-RIGHT 
[  (NODE  =x)  -(RIGHT  ==  X  =  any  thing)  — >  ] 

PRINT 
(  (NODE  =x)  -(ALREADY-P  -x)   — >  (<write>  -  x)  (ALREADY-P  -x)  ] 

GO-UP 
[  (NODE  =x)  (FATHER  =  x  =  y)   — >   (<delete>  (NODE  =  x)  )  (NODE  -  y)  ] 

STOP 
[  (NODE  =x)  (ROOT  =  x)   — >   {<delete>  (NODE  =x))  (<halt>)  ] 
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FIGURE  2.  SAMPLE  TRACES  FROM  PI NARY  TREE  FS  RUN. 


(START-FOINTING  NIL  (1)  (2  2)) 

(PRINT  (STOP  CAN-T-GO-RIGHT  CAN-T-GO- LEFT )  (1  2)  (3 

(STOP  (CAN-T-GO-RIGHT  CAN-T-GO--LEFT )  (1  4)  (5  6)) 


4)  ) 


A 

« 


(START-POINTING  NIL  (9)  (10  10)) 

(GO-LEFT  (STOP  PRINT  GO-RIGHT)  (9  10)  (11  13)) 

(PRINT  (GO-UP  CAN-T-GO-RIGHT  CAN-T-GO-LEFT )  (12  13) 

(GO-UP  (CAN-T-GO-RIGHT  CAN-T-RO-LEFT  )  (  1 -:> 

(PRINT  (STOP  GO-LEFT  GO-RIGHT)  (9  17)  (18 

(GO-RIGHT  (STOP  GO-LEFT)  (9  19)  (20  22)) 

(PRINT  (GO-UP  CAN-T-GO-RIGHT  CAN-T~GO-LFFT )  ^oi  n 

(GO-UP  (CAN-T-GO-RIGHT  CAN-T-GO-LEFT) 

(STOP  (GO-LEFT  GO-RIGHT)  (9  26)  (27  -^ 


15)  (16 
19)  ) 


(14 
7)  ) 


-LEFT)  (21 
(21  24)  (25 
?8)  ) 


^2)  (23 
26)) 


15)  ) 


24)  ) 


IB)  ) 
19  21) ) 
'T)  (20  21) 

(20  23)  (24  ?.:; 


(22 
)  ) 


(GO-UP 
(GO -UP 
(PRINT 


(START-POINTING  NIL  (14)  (15  15)) 
(GO-LEFT  (STOP  PRINT  GO-RIGHT)  (14  15)  (16 
(GO-LEFT  (GO- UP  PRINT  GO-RIGHT)  (17  18)  (1 
(PRINT  (GO-  UP  CAN-T-GQ-RIGHT  CAN-T-GO-LEFT) 
(GO-LIP  (CAN-T-GO-RIGHT  CAN-T-GO-LFFT ) 
(PRINT  (GO-UP  GO-LEFT  GO-RIGHT)  (17  25)  (26  27)) 
(GO-RIGHT  (GO-UP  GO-LEFT)  (17  27)  (28  30)) 
(PRINT  (GO-UP  CAN-T-GO-RIGHT  CAN-T-GO-LFFT)  (-:'9  30)  (31 
(CAN-T-GO-RIGHT  CAN-T-GO-LEFT)  (29  32)'"(33  34  ) 
(GO-LEFT  GO-RIGHT)  (17  34)  (35  36)) 
(STOP  GO-LEFT  GO-RIGHT)  (14  36)  (37  38)) 
(GO- RIGHT  (STOP  GO-LEFT)  (14  38)  (39  41)) 
< GO-LEFT  (GO-UP  PRINT  GO-RIGHT)  (40  41)  (4^  44)) 
(PRINT  (GO-UP  CAN-T-GO-RIGHT  CAN-T-GO-LEFT)  (43  44)  (45 
(GO-UP  (CAN-T-GO-RIGHT  CAN-T-GO-LEFT)  (43  46)  (47  48))^ 
(PRINT  (GO-UP  GO-LEFT  GO-RIGHT)  (40  48)  (49 
(GO-RIGHT  (GO-Ui^'  GO-LEFT)  (40  50)  (51  53)) 
(PRINT  (GO-UP  CAN-T-GO-RIGHT  CAN-T-GO-LEFT) 
(GO-UP  (CAN-T-GO-RIGHT  CAN-T-GO-LEFT)  f-^-.o  ■=■<=■■ 
(GO-UP  (GO-LEFT  GO-RIGHT)  (40  57) 
(STOP  (GO-LEFT  GO-RIGHT)  (14  59) 
>> 


23)  ) 


32)  ) 


(52  z,: 
(58  59) ) 
(60  61 ) ) 


) 


,0)  ) 

52  53)  (54 
(56  57)) 


46)) 


55)  ) 
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I-IGUFCE    3.     SAMF'LE    CRAPS    OUTPUT    FROM    BINARY    IRF.F    PS    RUN. 


((0  .  START-POINTING)  NIL) 

LIF  (GO-LEFT  STOP  PRINT  GO-RIGHT)  THEN 

[REPEAT     (WHILE   (GO-LEFT  GO-RIGHT)) 
(UNTIL   NIL) 
« 
CREPEAT     (WHILE   (GO-LEFT  GO-RIGHT)) 

(UNTIL   (CAN-T-GO-LEFT  CAN-T-GO-RIGHT ) ) 
<< 
((13  .  GO-LEFT)  (STOP  PRINT  GO-RIGHT)) 

D 

CREPEAT     (WHUE   (CAN-T-GO-LEFT  CAN-T-GO-RIGHT)) 
(UNTIL   (GO-l.TFT  GO-RIGHT)) 

((15  .  PRINT)  (GO-UP  CAN-T-GO-RIGHT  CAN-T-GO  LEFT )  ) 
CREPEAT     (WHILE   (GO-UP)) 

(UNTIL   (PRINT  STOP) ) 

((16  .  GO-UP)  (CAN-T-GO-RIGHT  CAN-T-GO-LEFT)) 


((17  .  PRINT)  (GO-UP  GO-LEFT  GO-RIGHT)) 
(do  .  GO-RIGHT)  (GO-UP  GO-LFFT)) 


ELSE IF  TRUE  THEN 


((1  .  PRINT)  (STOP  CAN-T-GO-RIGHT  CAN-T~GO-l  ..EFT )  ) 
CIF  (GO-UP  CAN-T-GO-RIGHT  CAN-T-GO-LEFT)  THEN 

CREPEAT     (WHILE   (GO-UP)) 
(UNTIL   (STOP)) 
« 
((30  .  GO-UP)  (CAN-T-GO-RIGHT  CAN-T-GO-LEFT)) 


ELSEIF  TRUE  THEN 


((2  .  STOP)  (CAN-T-GO-RIGHT  CAN-T-GO-LEFT)) 
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6.   Algorithms 

In  this  section  we  outline  the  algorithms  which  produce 

CRAPS  descriptions  from  a  set  of  sequences  of  rule  applications 

which  solved  a  particular  family  of  problems.   The  exact  form 

of  an  input  sequence  is  <<  PI  P2  >>,  where  Pi  is  of  the 

form  (p1  (PiiPi2--.Pir„)  (niini2...nij)  (0110^2)),  where  P^  is  the 

rule  which  was  applied  on  the  i ' th  cycle  of  execution.   (P-iPi2.. 

•Pim^  is  the  list  of  rules  v;hich  were  applicable  on  the  ith  cycle 

and  describes  the  data  envirom-ent  at  that  point  in  the  execution. 

^'*il^i2- • -"ij^^^  the  list  of  unique  numbers  associated  with  the 

instances  of  data  elements  which  matched  the  rule  ?[,  and  (Oi3^0i2) 

is  the  range  of  numbers  associated  with  the  data  elements  deposited 

in  working  memory  by  the  application  of  rule  pj .   The  sequence 

presented  is  an  exact  history  of  the  execution  of  the  program  and  is 

therefore  already  partially  ordered  by  the  back  dominance  relation. 

Tliis  makes  the  subsequent  pattern  recongnizing  easier. 

The  initial  approach  we  considered  to  finding  permutations  of 

rule  applications  in  the  sequences  was  to  do  a  static  analysis  of 

the  rules  to  determine  which  rules  were  permutable,  i.e.,  which 

rules  produced  output  that  could  not  be  input  by  other  rules. 

This  approach  was  found  to  be  too  difficult  and  not  general  enough. 

Instead,  we  use  techniques  similar  to  those  developed  for  program 

optimization.   Using  the  input/output  information  contained  in  the 

trace,  a  data  flow  directed  acyclic  graph  fOAr:)  ip  con? true t<=d 

whose  nodes  correspond  to  r"lc  ^-r^i  ^^--^  ■>"'--c  --'T  ,.v,_„^  ^j  „ 

wot^^.i^  ^^   ^w.^i_  ocj..i^j.u.c.^c^wiiS  m.a  whose  edges  represent 

the  flow  of  data  from  one  rule  to  another.   This  DAG  completely 

specifies  all  ol  the  data  dependencies  and  rherefore  all  of  tne 
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possible  execution  sequences.   After  the  DAG  is  cleansed  of 
irrelevant  forward  arcs  (see  Tarjan  [13,14,15]),  it  is  linearized  to  a 
CRAPS  description  employing  permutation  and  simple  units  only.   The 
construction  of  permutations  is  based  on  the  observation  that  if 
a  node  has  two  or  more  entering  edges  then  the  subsequences 
associated  with  its  predecessors  can  be  permuted.   A  simple 
sequential  scan  of  the  nodes  in  tho  DAG  according  to  the  partial 
ordering  is  sufficient  to  produce  a  linear  doscriptioii  in  linear  time. 

The  next  processing  is  the  detection  of  repoatirig  subsequences 
and  formation  of  repetition  units.   Unlike  the  perrautation 
detection  problem,  which  is  well-defined,  and  which  is  solved  by 
the  algorithm  described  above,  some  sequences  may  have  several 
equally  acceptable  descriptions  using  the  repetition  operator.   The 
algorithm  we  use  gives  one  description.   We  first  scan  the  sequence 
identifying  all  unique  units.   All  such  units  cannot  be  part  of  a 
repetition  and  thus  divide  the  sequence  into  shorter  subsequences  to 
VJhich  the  entire  procedure  can  be  applied  recursively.   Once  a 
candidate  subsequence  is  found  (every  unit  in  it  appears  at  least 
twice) ,  we  scan  from  loft  to  right  repeatedly  looking  for  equivalent 
adjacent  subsequences  replacing  them  by  repetition  units.   The 
procedure  stops  when  it  considers  lengths  greater  than  one  half  the 
current  length  of  the  sequence. 

The  final  operation  to  be  done  is  the  coalescing  of  several 
descriptions  produced  by  the  above  processing  into  one  description 
employing  the  alternation  operator.   The  construction  vio   consider  i  r, 
similar  to  that  of  v;inston  and  Hayes-Roth.   From  tv;o  or  mere 
descriptions  of  some  object  we  identify  the  points  of  similarity 
and  alternate  the  differences.   Gin^-t.:  Lhit.  pj.(./ulcm  is  equivalent 
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to  the  Longest  Corunon  Subsequence  problem,  v;hich  is  known  to  be 
NP-Complete  (See  Maier  [7  ]),  our  approach  is  highly  heuristic. 
The  computation  of  a  cormon  subsequence  is  performod  by  a 
concurrent  left  to  right  scan  of  all  sequences  v/ith  a  heuristic 
weighting  function  v;hich  gives  preference  to  repitition  units  over 
permutation  units  and  simple  rule  application  units. 

The  conditions  for  repetition  and  alternation  units  are 
computed  by  simple  set  expressions  on  the  list  of  applicable  rules 
(  (Pil^'j  2*  •  •  Pim)  above)  at  the  time  a  set  of  subsequences  are 
collapsed  into  a  unit.   The  final  output  of  these  algorithms  is 
fed  back  to  the  production  system  interpreter  and  used  for 
furtlier  problem  solutions.   Complete  details  of  these  algoritlims 
can  be  found  in  Stolfo  [  12]  . 


18  - 


7.   Conclusion 

It  is  believed  by  many  researchers  that  an  important  qiiality 
of  intelligent  behavior  is  the  ability  to  improve  performance 
with  experience,  and  that  generalizing  a  concept  is  a  critical 
aspect  of  learning.   In  CRAPS,  a  form  of  generalization  occurs 
when  a  repeating  subsequence  is  collapsed  into  a  repetition  unit. 
Although  q\iite  restricted  in  scope,  CRAPS  shows  how  a  system  might 
learn  procedures,  a  form  of  learning  which  v;o  believe  is  very 
important.   Although  there  are  a  number  of  very  difficult  tcclmical 
problems,  it  seems  to  us  that  v/ith  more  powerful  pattern  recogni- 
tion techniques  and  more  pov/erful  generalizations  of  control 
str.toments,  this  approach  could  be  very  fruitful. 

With  less  ambitious  designs,  CRAPS  can  bo  viewed  a"  a 
progrcuianing  aid  for  the  designer  and  implementer  of  a  large  AI 
problem-solving  knowledge  base.   The  CPJvPS  approach  might  be 
useful  in  fine-tuning  a  declarative  knowledge  base  as  opposed  to 
•hand-compiling'  control  elements  to  effect  competent  perfoinnance 
in  such  a  system. 

The  power  of  the  descriptions  produced  is  limited  by  both 
the  expressive  power  of  the  CRAPS  primitives,  and  the  level  of 
sophistication  of  tlie  pattern  recognition  algorithms  that  have 
been  developed.   For  example,  during  repetition  detection  no 
notion  of  similar  subsequence  is  used;  rather,  a  subsequence  must 
appear  exactly,  vhich.  prevents  alternation  units  from  app-^aring 
within  repetitions.   Despite  this.,  trie  ;n  Ignri  t"nm«5  p\-rc^   powerful 
enough  to  detect  interesting  patterns  and  subsequently  in teres  ling 
heuristics. 
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Our  oxporimcnts  suggest  that  this  approach  will  have  the 
best  chance  of  success  when  the  encoding  of  the  knowledge  of  the 
problem  domain  is  such  that  on  any  execution  cycle  a  small  number 
of  productions  and  only  one  instantiation  of  each  production  is 
applicab].e.   This  suggests  one  way  in  v/hich  CRAPS  should  evolve: 
the  execution  traces  should  include  not  only  productions  but 
also  the  instantiations  of  productions.   However,  recognizing 
patterns  in  the  sequences  V7hich  include  data  is  a  much  more 
difficult  problem.   We  viev7  our  approach  as  an  initial  step  in 
the  undorir'canding  of  this  more  general  problem. 
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APPENDIX  I 

Jigsaw  F'ljzzle  F'r oo'uct ion  System 

In  what  follows  f  data    elements  csri  b&  any  LISP  data  structure. 
An  stomic  data  element  must  match  exactly  and  s  list  must  mgtch  a 
list  with  the  same  structure  arid  coriterit.   A  t>yn.bo].  precedf^d  with 
an  eouals  si^n  (  =  )  represents  a  variable  which  c;>n  mstcri  ans  dat.^ 
structure.   The  *  symbol  contained  in  productioris  'nnzi    the  s?-me 
function  as  the  SNGBOL^  coridi  t  i  ons  1  assignment  orei-ator  <:  ,  )  ,       Uheri 
a  rule  is    fired*  the  data  elements  are  not  deleted  fTorn  woiK.Tn<^: 
memory  unless  they  are  included  as  ars$um€?rits  to  tiie-  <deletG>  system 
function  in  the  risiht  hand  side  of  the  rule.   The  other  <;-.ystem 
furictions  cofitained  in  the  rules  are  i^epresented  iri  lower  case  arrd 
enclosed  by  pointed  brackets  (<  >).   Their  functiori  is  described 
by  their  names.  The  symbol  '  is  an  operator  wiiich  matciies  the 
entire  remaining  portion  of  the  list  follot-iin^'  it-   Where  li 
appears  in  the  ris-ht  hand  side?  it  deposits  the  list  thai  rnatched 
but  it  strips  away  the  enclosins  parentheses. 

Work  ins  Meniory  Data  Elements; 

1.  (PIECE  p  c)  represents  a  puzzle  piece  where  p  is  a  uniaue  intesier 
associated  with  a  Piece  and  c  is  its  average  color.   Ue  will  assume 
the  machine  knows  at  any  time  where  piece  p  is  located  arid  so  we 
is'nore  locatiori  iri  the  rep  reseritat  iori . 

2.  (SIDE  s  p  n  c)  represents  the  side  of  a  puzzle  piece,  s  is  either 
LEFT»  RIGHT?  TOP  or  DOTTOM  of  piece  p.   Since  location  is  isnored? 
rotation  of  a  piece  in  spsce  is  also  isnored.   n  is  an  inteser 
rep-resenting  the  shape  of  the  side  where  l-n  riiates  with  -n  arid  0 
represents  a  strsisht  eds^e.   c  is  the  color  of  the  edse .   The 
representation  could  easily  be  extended  to  represent  a  vector  of 
colors  for  a  series  of  points  on  the  edsie. 

3.  (NUMBER--OF-PIECES  n)  states  that  n  is  the  total  number  nf  pn-zle 
^ i ece s  : 

4.  (JOINED  (sidel  side2)  (side3  side-*)...)  represen+s  the  s-^-.-^uence 
of  zidcz  thr^t  were  Jcir.cd  ir.  fzT-.\r,^  the  r^jzzlc;.  Thi  Ss.v.bC'l  ^idc.j. 
is  of  the  form  2  above. 
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5.  (  IN--F'U77Lr:     (PIECE    r-    c))     st^^tps    that    Fiece    p     lo     in    the    punzle, 

6.  (NUrtBf:F<-IN-F'UZZLE    n)     states    that    n    it    the    (vjii.ber    of    puirL'le    Piece?. 
t^l^!t    are    d  ri    the    puzzle. 

7.  (CURFEN 1  -  COLOR    c)     represents    the    cuirent    color    of    rr.    object    beins; 
corrsicie  red . 

8.  (HOLDING    p)    states    that    f     is    the    cnrent    oh.je.t    beinji    i-ield    (foi- 
e;:ar(iple    a    puzzle    pie-ce).        If    the    harid    is    eiTipty?     (MOLDING    NOIHIriG)     is 
in    worLinfi    rriertiory, 

9.  (  IN--HLAi-'    (PIECE    p    c))     represents    puzzle    piece    p    ss    beinsi    in    a    heap 
with    no    implicit    ordering    of    edsies. 

10.  (LOOKING-AT    )'.)     states    that    object    x    is    in    view.        If    riothin<:-'    is    in 
view    then    (UDOKING-hT    NOTHING)     is    in    work  ins    nr-n.ory. 

n..     (P<E1NG-PLIT-IN-PUZZLE    ;; )     represents    the    current    piece    x    that    is 
actively    beirii    placed    in    the    puzzle. 

F-'  r  o  d  u  c  1 1  o  r  1    ri  o  n\  o  i'  y  J 

L  0  0  K  -  (-,  1  -  F^'  I E  C  E  -  I N  -  H  E  A  F' 
[:(LnuKING-AT    ^=object)    $    ==cl 
(IN-HEAP    (PIECE    =p    =c)     i>    -^oboect) 

( <delete>    -cl ) 
(LOuls:iNG--AT    =QbJect);i 

L.  0  0 1(  -  ^•,  T  -  G  D  J  E  C  T  - 1 H  -  H  A  N  D 
C(LOOLING-AT    =somethins  >     $    =-cl 
(HOLDING    ^^ob^iect) 

(<delete>  ^^cl) 
(LLIOKING-AT  -^object)! 

CLOSE-EYES 

L(LnnK.iNG--AT  =^sorf,ethi  n^- )  $  ^cl 

-(LOO  K 1  fi  G  -  A  T  N  L)  1 II I N  G  ) 


(<delete>  ---rl) 

(LOOK I NG- AT  NOTH I NG ) 1 


ODJECT-IN-HAND-IN-VIEU 
C  (HOLDING  ^=obuect) 

(LOOKING- AT  =^object) 
~ ( LOOK  I NG- AT  NO  TH I NG ) 


PICK-UP-ODJECT-IN-VIEU 
L (HOLDING  NOTHING) 
(LOOKING-AT  =obJect) 


\     I   I V  —  r  t  r-  t-tr-        —  i  1 1  i .  !♦■-•  r  •  i 


3) 


(<delete>    =- 

/I   nnv-  T  kin  .   AT 


(HOLDING    =-obJect)] 
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F'UT-PIFCF-rmUN-TN-HEAP 
C  (HOLDING  (PIECE-  =  f^  ==c))  $  ---cl 
(LOOKING-AT  -object) 


( <delete>  =cl ) 
(LOOKING-AT  --object) 
(HOLDING  NOTHING) 
(IN-HEAP  (PIECE  =p  =c))l 


FIND-COLOR-OF-PIECE 
C(LO0KING"AT  (PIECE  ^p  =c)) 
(CURf<ENT-C0L0R  --^snythinss )  $  =c2 


(<delete>  =c2) 
(CURRENT--CGLnR  --^c)3 


FORGET-COLOR-OF-PIECE 

C:(  LOOKING- AT  (PIECE  ■-^■f    '-^c))     *  =cl 


(<nif:flGle>    ^cl  "C2) 

(LOOKIfJG--AT  NUTIITNG) 

(  C  U  R  F;;  E  N  T  -  C  0  L  0  F;.'  NO]Hli>  G  )  "J 


PIECE--HAS-STRAIGHT--EDGE 
C(LnOKING-AT  (PIECE  -p  =c)) 
(SIDE  =^any  ~p    0    ^^c) 


PIECE-HAS-CURRENT-COLOR 
[(LOOKING- AT  (PIECE  =-p  =c)) 
(CURRENT- COLOR  ==c  ) 


HEAP-IS-EMPTY 

C-( IN-HEAP  =3ny thins) 


START-PUZZLE 

C-( IN-PUZZLE  =5nythine) 

(HOLDING  (PIECE  =-f  =c)  $  =-obJect)  $ 

(LOOKING-AT  =ob^iect) 


—X  JOINED  ) 

(<delete>  =c2) 
(HOLDING  NOTHING) 
(IN-PUZZLE  =obJe>ct) 
(LOOKING-AT  ---object) 
(NUHDER-IN-PUZZLE  1)D 


PIECE-FITS- IN-PUZZLE 

L  (LOOKING-AT  (PIECE  =p  --=c)  f.  ^object) 

—  I  I  rj  —  »-•  I  t  /  /I  t-   —r%  r%  ^  t .— .  z-'  -t  » 

(IN-PUZZLE    (PIECE    "p2    ^otherc)     $    "otherp) 
(SIDE    -Bn\j    =p    --n    "c) 

/  c  T  ric    --,.-.  ,-v  4- K  .-N  p    ~7-2    (  <  TiC-iw  t  i '.'c  ■'■•    -r. )    —I'-.) 

—  >       D 
1.3 


-c)     $    -object) 


F 11  -F  lECL-  lN-f\JZZLE 

[(HOLDING     (Pnr.CE    =^F- 

-(IN-PUZZLf:    ^obj-sct) 
(LOOKING-AT    =^Qb^ect) 
(IN-PUZZLE     (PIECE    ---p?.    ^^otherc) 
(SIDE    -Bny    -p    =ri    =c)     $    =c4 
(SIDE    =  a  not  her    =p2    (  OiGSiat  i  ve  >    =ri) 
(JOINED     I     =r€-5t)     $    ^c6 


$  -  o  t  h  e  r  p  ) 

^k  )  ^  =c5 


(<:delete>  =c4  =c5  ---cS) 
(DE I NG-PUT- IN-PUZZLE  =objL-:-r  t ) 
(LOOKIN'G-AT  =ob.jert) 
(JOINED  !  =rest  (^c^  =c5))j 


PIECE-PUT- IN-PUZZLE 
[(HOLDING  (PIECE  =p  ^c) 

( NUhDER- IN- PUZZLE  -m ) 
-(IN-PUZZLE  =^objec+. ) 

(DEING-PUT- IN-PUZZLE  --^obuect) 


$  -object) 


^cl 


$  --C'^ 


(<Qelete>  -cl  =c2  -c4) 
(HOLDING  NOTHING) 
(LOOKING-AT  NOTHING) 
(IN-PUZZLE  ==ob-jK?ct) 
(NUMBER- IN-PUZZLE  (<5Qdl. 


=  rf, )  )  J 


PUZZIE-IS-FINISHED 
C  (  NUhDER-  IN-PUZZLE    =rr ) 
(NUHDER-OF -PIECES    ^^  n  ) 
-(  IN-  IIEAP    =sriythin^) 


(<hslt>)D 
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AF'PENDIX  II 

Exterisions  to  Jigsaw  F'uzzle  F'rorJuc t ion  Systerti 

Working  Memory  J 

1.  (NUME<ER-OF-F'ILES  m )  m  is  the  nunibe-r  of  piles  we  hsve  (initiiclJ.  y  0). 

2«  (CUr«;F<ENT-F"IL.E  n)  represents  the  current  pile  ne  zre    ur-ing. 

3.  (AL.L-F'ILES  p1  p2  ...)  represents  c";ll  of  the  piles  we've  made 
where  Pi  is  b    uniaije  integer  sssocisted  with  a  pile. 

4.  (F'lLE  1  tl  t2  ...)  represents  the  contents  of  Pile  i  where  t-.i  can 
be  any  object. 

F'roductiori  henioi-yJ 

MAKE-A-F'ILE 

C  (HOLDING  (::riot>  NOTHINlO  $  --^^object)  $  =^cl 

(LOOKING-AT  =:^obJect) 

(NUhBEFv-OF- PILES  =rf.)  $  ==c3 

(ALL-PILES  !  ^r)  $  =c4 

(CURlFvENT-PILE    NOfJE )     $    =-^c5 

(<delete>  -cl  -cS    --cA    ^-c^) 
(NUMBER-OF-PILES  (<f<Qdi::  =Mri )  ) 
(LOOKING-AT  ^^obJect ) 
(ALL-PILES  (<addl>  =m)  !  ^^  r ) 
(CURRENT -PILE  (<sddl>  =nr. )) 
(PILE  (<i^ddl>  =i7i)  :^:^nbJert) 
(HOLDING  NOTHING): 

PICK-A-PILE 

C  (CURRENT-PILE  NONE)  $  =^cl 
(ALL-PILES  ^f'l  !  ---r) 

(<delete>  =cl) 
(ALL-PILES  -Pl  '  -r) 
(CURRENT-PILE  =p1):I 

PICK-OBJECT-FROh-PILE 
C (CURRENT-PILE  =p1) 

(HOLDING  NOIHING)  $=-c2 

(ALL-PILES  --Pl  !  =^r) 

(PILE    ^-^Pl    ^njDject     !     =rest)     *    --^^c4 

(LOOKING-AT    --^ob.ject) 

(<delete'>  ~n7    -rA) 

(HOLDING  =objoct) 
(PILE  ^Pl  !  =rest)l 


II  .  1 


PUT-OBjrCT-  IN-F'Il  E 

C(CIJRRENT-F'ILE  ^p1) 
(HOLDING  f  r.ot;^  NOTHING) 
(L00KING-A7  ^object) 
(ALL-F'ILES  =Fl  !  -  r ) 
(F'lLE  =p1  !  =Tost)     %    --^c5 


=  Ob.JPCt)  $  -c2 


(<delete>  =c2  =c^^) 
(LOOKING-AT  =object) 
(HOLDING  NOTHING) 
(F'lLE  =p1  !  =rest  -object  )D 


F0fv'6ET-THIS--F'ILE 
L(CLlf;;F<EN(-  PILE  =p1  ) 


(ALL- PILES 


•1 


$   :=Cl 

rest)  $ 


-C2. 


(<de'let&>  =cl 
(CURRENT-  PILE 
(ALL-PILES  !  = 


-c2> 

NONE  ) 

■  r  iOf  ?,  t  =  p  1  ) 


PILE- IS- EMPTY 

t (CURRENT-PILE  =p1 ) 

(ALL-PILES  -pl  !  -rest) 

(PILE  =pl) 


DESTROY -A-PILE 

C  (CURRENT- PILE  =-p1)  $  =cl 

(ALL-PILES  ^pl  !  =T-c-5t)  $  -c2 

(PILE  ^pl  !  :m-)  $  =^c3 


THERE- ARE-NO- PILES 
C (CURRENT-PILE  NONE) 
(ALL-PILES) 


LOOK-AT-PIRST-IN-PILE 

C (LOOKING-AT  ^anything)  $  =cl 

(CURRENT-PILE  =p1) 

(PILE  ~pl  =obut>ct  !  =rest) 


(  <:  dele  t  c  >    -  c  1  =  c  2  -  c  3  ) 
(CURRENT-PILE  NONE) 
(ALL-PILES  !  ---rest).1 


(<delete>  =cl ) 
(LOOKING-AT  =object)D 


LOOK-AT-NEXT-IN-  PILE 
I.  ( LUUKING-H  I  ^Object)  %    =cl 
(CURRENT-PILE  ^p1) 


—  I II  i .  I*-* t  ■ 


- 1  I  ►-*  :•;  I . 


(vdelett-::-  =cl  =c3> 
(  LOOKI  MG-.'^T  -^■'•'■■t- \ 
(PILE  =p1  -next  !  =r  =obJect)D 
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